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ABSTRACT 

A series of studies was conducted to: (1) examine the 
effects of headings on .both recall (a memory task) and retrieval (a 
search task) from the same text; and (2) distinguish between 
retrieval from unfamiliar text and retrieval from familiar text. 
Pupils aged between 14" and 15 years of mixed reading ability took 
part in six separate studies, each of which partially replicated and 
partially expanded the previous studies. Preliminary results suggest 
that headings aid both the recall and retrieval of information from 
A the text. The position of the headings (marginal or embedded) had no 
effect on the results, but the headings (questions or statements) 
might have differential effects with learners of different ability 
(headings' enhanced the recall of low-ability subjects). It also 
appears that headings in the form of questions might be more 
effective than headings in the form of statements for less able 
readers. Farther experiments in this area are planned. (Author/CM) 
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Abstract 



This report describes some of the issues confronting research workers 
who want to carry' out "research on the effects of headings in text. 
An overall strategy of attack is . formulated and the results presented 
from six of nine experiments necessary to complete the first stage of 
the research. These preliminary results suggest that headings aid 
both the racall and the retrieval of information from the text used 
in these experiments. It seems that the position of the headings 
•(marginal or embedded) has no effect on the results, but that the 
headings (questions or statements) might have differential effects with 
5 learners of different ability, (headings enhancing the recall of 
lc*rf -ability participants). It also appears, but this remains to be 
tested more thoroughly, that headings in the fora of questions might 
be more effective than headings in the form of statements for less able 
readers. * 



Key words 

headings 

text layout 

text comprehension 

retrieval from text 



Introduction < >fa m 

. If, as teachers;' researchers or writers, we were to ask about 
' the effects, of headings in^text, a number of issues might be 
. raised. We could 'for instance, ask questions about: 

I m - * 

• the presence, of. "headings" versus their absence 

* • the effects of headings on recall or. retrieval <or both) 

• the position of headings 
» the frequency of headings 

• the kinds of headings -(e.g. questions., vs statements; 

short vs long) ' ' 
• • 'the kinds of text in which headings might appear (e.g. high vs 
: low structure; technical vs semi-literary) 

• the typographic denotation of different levels of headings 
. » the effects of headings on immediate and lonjg-te.rm recall 

• the effects of age and ability 'in using headinge -; 

• the effects of constructing headings for text we are reading 



• and so on. 



Unfortunately, if we examined the research literature on these 
topics, we would find 'no clear answers to our questions. 
Panel 1 summarises the research on headings. It is apparent < 
from Panel 1 that: 

over half of the studies are very recent ones 

• most of the studies address the topic of the effects of 
headings on the recall of information after reading the text 

• ' few studies address any- other issues. 
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■ Some other points, not apparent from Panel 1, are that few 
investigators have studied more than three of the issues listed " 
above, and no-one .has- investigated any of them systematically. 
Indeed, all of the studies, cited in Panel 1 (including o.ur own) 
may be characterised, as f one-off* ones. 

**' • 

So, because of the paucity of experimental studies, no general 
conclusions can be drawn about the value of headings for, 
instructional text'. Different investigators, have used 
different texts, different kinds of headings, different learner 
samples, and different ways of testing the effectiveness of 
headings. Consequently no-one 'is yet in a position t to proffer 
clear guidelines of how headings in text can best be used. 

*What seems to be required to achieve this is a series of studies,' 

€ 

each one of which partially replicates and partly builds upon the 
previous one(s). We have begun a series of such studies, and it 
is our intention in this report to present the Results from as many, 
studies' as we have completed at the tice of writing. 

i 

Our experiments. : an overview 

It has been suggested that headings car. be used to aid recall 
(ifi memory tasks) and to aid retrieval (in search tasks) but 
no-one to our knowledge has examined the effects of headings 



Panel 1. Experiments on headings : a survey oS^ issues and* studies 
• (* indicates a significant result) 



Iggy: Effects of headings on .recall b-f information 
Robinson and Hall (19**1 ) 
Christensen and Stordahl (1955) 

* Klare et_ al (1958) 

Cole (1977) * . 

* Doctorow et al (1978) 

* Dee-Lucas and Di Vesta (1980) 
♦ t Hartley et_ al (1980) 

* Hartley e£^L ( 1981) 

* * Holley et al (198D 

Brooks et_ al (1981) 

9 2. Effects of headings on retrieval from familiar text 
Charrow^and Reddish (1981) . 

I ' 

3. Effects of headings on searching unfamiliar text 

* Hartley and, Burnhill (19?6) 

9 

*f. Effects of different frequencies of headings 

* Klare ct al (1958) 

5. " Effects 'of different kinds of headings 
Christensen and Stordahl (1955) 

i 

* Hartley efal (1980) • 



, * Hartley et al O981) 



4 

\ 
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•\ - ■ «. ■ 

Effects of headings on long term recall 
' Christensen and Stordahl (1955) 

* Hartley at al (.1980) 
•* Hartley et al O981) 
..* Holl«y et_al (1981) 

Effects of headings on readers of different ability 

* Klare et al (1958) • . 

* Hart rey et_al (1980) ' 

Effects of instructing readers to use headings ■ 
Cole (1977) 

Holley et_al (1981) * j ' 

* brooks et al (198D 

* * 

Effects of instructing readers to generate headings 

* Doctorpw et al (1978) 

* Dee-Lucas and DiVesta (1980) 

* 

Holley et al (1981). ' * . ' 

€ ■ t 

Effects of headings on preferences for text 

* Klare et al (1958) 

* Charrow and Reddish (1981) 

.Effects of the position of headings in text 
(no studies.) 



on both recail and retrieval from the same text* Similarly, 
no-one to our knowledge has distinguished between retrieval 
from unfamiliar text (i.e. a -search task) with searching in 
familiar text (i.e. a retrieval ttfek). 'Commentators have, 
suggested that it is easier to retrieve from text that hay 
marginal headings (as opposed to Embedded ones^ and our own 
previous research Ijas suggested that headings in the form of 
questions help less-able readers, (e.g. Hartley et al ,- 1980 f 1981) 
vOur .experiments thus;presently focus on: 

» refcall' and retrieval (from unfamiliar and familiar text); 

• the position of headings (marginal vs text embedded); and 

• the kind of 'headings used (questions vs statements). 

* > 

\ 

At present we use a four page typescript version of a piece- ■ 
of semi-technical prose as our text' material. Ve intend at 
a future date to replicate our findings' with both more. and 
less technical *text, and to investigate the effects of age and 

ability with these different texts* 

\ 

V 

Generally speaking, in these experiments the participants are 
presented with the passages of text in the conditions shown 
schematically in Figure 1. (The headings may be either in 
the form of ouestions, or statements.) The amount of text is 
held constant on each page, and the only thing that varies is 
the presence- or absence of the headings. 

The* passage contains approximately one-rthousand words and is 
about television viewing habits' in the United Kingdom. It has 
a Flesch reading ease score of 55", i-e* it is 'fairly difficult 1 
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Figure 1- A schematic representation of the conditions -used 
. in the studies reported in this paper. * 



or suitable for 15-17 ^ear olds. The passage is subdivided into ^ 
twelve paragraphs, and as a report of a questionnaire t it contains^ 
a large number of fact? and figures. .In the headings conditions 
there are six headings. - approximately one^ every two paragraphs. 

A^t^eJLve item-shqrt-answer test is attached to the^back of each. 

of the four versions of the passage.' These test questions do not * 

^ 

repeat questions asked in the headings. The text headings indicate 
'structure (e.gv f How do people react to the BBC?*) whereas the % * 
test questions are more specific (e.g. 'What percentage of viewers 

i 

^were dissatisfied with BBC 1 programmes? 1 ). \ 

v- * ■ ' p . 

Figure 2 illustrates the overall - or master plan - of our 
current x*esearch. Experiments 1 and 2 focus on recall, and 
Experiments 3 and h and 5 and 6 on retrieval. The precise conditions 
to be used in Experiments 7, *o and 9 depend upon the outcome of 
Experiments 1-6. So, using the plan of attack described in * * ■ 
Figure 2, what have we found? • Let us take each experiment in turn. 
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• Recall 
Expt* 1 Headings as statements 
position varied 



Expt* 2 Headings as questions 
, position varied 



* Recall 

Expt* 7 Headings as statements versus ' 
headings as questions/ position 
controlled 



\ 



Search - ' (unfamiliar text) 
Expt ? ' 3 Headings as statements ~ 
position ^varied N i 



Expt. h Headings as questions 
position varied 



Search (unfamiliar text) 
Expt* 8 Headings as' statements versus 

headings as questions, position 
controlled 



Retrieval (familiar text) 
Sxpt. 5 Headings as ^statements 
position varied 



3xpt*> 6 Headings as questions 
/ position varied 



Retrieval (familiar text) 
Expt* 9 " Headings as statements versus 
: 'headings as questions, position 

; controlled \ 



Figure 2. A schematic diagram of the research strategy. Experiments 7, 8 and 9 
depend upon the outcome of Experiments 1-6. 



v ■ * 
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EXPERIME??? "ONE 



Aims i ^ j 

The aims of Experiment One Were '(i), to see if headings written in 
the form of statements improved readers 1 recall of factual . 
"information* and (ii) to see if " the position of au heading (embedded 
in the text or placed in the margin) affected readers 1 recall of 
information* \ • * * . 



Pa rticipants* One hundred and seventy fourth-year comprehensive* 

school pupils (aged between 1** and 15 years) of mixed-ability took 

part in this eriquiry* Tlie pupils were 'divided by the school -into 

three groups of ability at English - hx-W^ middle, and low -*anl were 

taught in separate sets* Pupils 'in the, remedial section of the 

English department ^id not participate* 

* * 



Procedure v . 

< : • ^ 

Booklets in each of the four conditions shown in Figure 1 were 
distributed systematically to the participants in two separate classes 
by two experimenters on each of^two separate days* Each' bobklofc 
'contained a cover sheet, one version of the passage, and a test-sheet 
on the back* 



7. 



The participants v/ere asked to read the passage through once carefully, 
and then when 'they had completed their reading to turn the booklet 
over and answer the test questions on the back. They were instructed, 
to leave the answers blank or to guess at the answers to questions 
they could not complete and to go on to the next question. 



• . : . \ . ■ • 8 

In order to reduce the possibility of cheating the participants were 
told that four ways of presenting the same passage were being 
compared, and that the experiment was cohcerned^with testing the 
effectiveness of the different versions. In addition/the order of 
the questions asked on the test-sheet was varied for each of the 
four conditions. . m 

The experimental procedure used was that of a^four groups design 
with "different participants in each group. 

Results " ... r . v ■ *~ ' 

.results obtained from this enquiry are shown in^ Table 1. 



Analyses of sub-groups, showed: : 

m no significant position effects Sot the 'headings : participants with 
marginal headings (x = 7.6) performed as well as participants with 
, embedded headings/ (x = 7*5); ' . 

0 no significant ^differences between the two control passages :* 
participants with the longer line-lerfgth (x = 6.8) performed as" 

* well^as participants with the shorter one Cx = 6.8). 



TA BLE 1 . The results of Experiment 1. 

Average recall scores out of 12 
Headings in the form of statements. 



Boys 



Girls Total Overall 



Text ' 7.5 ' " 7.* . ij*^ ■ 

(N=23) (N=21) CN=H) ?#6 

Headings ' ' „ g <N=86) 

Margin 7.2 8.0 /•© 

* (N=25) -(N=19) -(N=A<*) 



Text 6.5 7.^ 6 «? N 

(N=18>- (»A2) 6.8 

COntr?1S Maxgin 6,6 7.0 ' >? 

g (N=210 (N=21) (N=A2) 



TABLE 2. The results of Experiment 1 expressed in terms of ability. 

Boys Girls 'Total 



High Ability 



Headings 
Controls 



9-3 

8.1 

(N=12) 



9-5 
(N=15) 

8.3 
(N=15) 



9.'* 
(N=29) 

8.2 
' (N=27) 



Middle Ability 



Headings 



Controls 



7-3 
(N=1*0 

,6.9 
(N=15) 



7.^ 
(N=16) 

'6.8 
(N=15) 



7.^ 

(N=30) 

6.9 " 

(N^-30) 



Low Ability- 



Headings 



Controls 



6.0 
(N=18) 

5.0 

(N=18). 



^.9 
(N=9) 

5.8 

0N=9) 



5.6 

(N=2J7) 

5.5 
(N=27) 



i *> - 



Accordingly,, it was deemed legitimate to pool the results for the 
headings groups and for the control groups. When this had been done, 
a two-way analysis of variance (presence/absence of headings x sex) 
was carried out. -The main results indicated: 

• an overall conditions effect: participants with headings (x = 7.6) 
did better than participants without them (x = 6.8). (F = *U55*S 
df 1,166, p v = .03&h " * . /- 

• no significant sex effects: girls (x = 7**0 di'd better than boys 

• (x = 6.9)- but this difference was not significant^ * (F = 2.015), It 
df*1,l66, p = .158):; . / . 

• no significant interactions between these variables, (F = 0.^55, 
df 1,166, p = .501)*. 

.IA the light of the data on ability obtained by Hartley et al ,1980 
(which suggested that low-ability pupils profit more from headings) 
the data were next examined for each of the ability streams in the 
English department. The data obtained are shown in Table 2. 

A three-way analysis of variance (ability x presence/absence of headings , 
x sex), followed by Scheffe tests when appropriate, showed that: 

• high-ability participants (x = 8.8) did significantly better than 
diddle -ability (x = 7.1) and middle-ability did significantly 
better than low-ability (x = 5.5), (F * ^5.9^, df 2,158, p<.00l); 

• no significant sex effects .(F = 0.03, df 1,158, p = .856); 

• participants with headings did better than participants without them 

(F = 6.25, df 1,158, -p<.02); the gain for headings for the high-ability 
participants was, 12$, for the middle-ability it was 11$ and for the- * 
low-ability it was 11$. 5hese differences were not significant : that is 
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there was no significant interaction between the levels of 
ability and the presence/absence of headings (F = 0.8j50* 
> . df 2,158, p = .438). - < 

F 

These results appear to coritradict those found by Hartley et al (198O) 

but, it must be remembered, that the differential effect with ability/ 

■ ' r ? 

found in the earlier study lay with headings written in the form of 
questions and npt written in the form of statements (as in this 
present, experiment). .Indeed, Hartley et al (1980) found that although 
headings written in the form of statements helped the recall, of . , * 
their three abi-l-i-ty-groups^ the amount of help was not clearly 
related to ability* * 

* * * » 

Conclusions * \ 

* . " °* 

The results o*f this experiment indicate a superiority for headings 
written in the form; of statements but they do not indicate any 
differential effect regarding their position* High-ability participant 
recalled more than low-ability ones, but there were no significant 
interactions between ability and the presence or absence of headings. 
These findings occurred when the headings were written in the form 
of statements ^ in Experiment 2 we turn to examine the effects of 
headings written in the form of questions. 



EXPERIMENT TV.O 

f • " _— - 

Aims - • 

* % 

,The aims of Experiment 2 were* (i) to see if headings written in ^ 

the form of questions improved readers 1 recall of factual information 
and (ii) to see if the position pf a heading (embedded in the text \ 
or placed in' the margin) affected readers 1 recall of information. 

Materials " m 

The Passage. The three versions of the passage on television viewing? 
— - * \ 

habits were employed In this experiment. They were as follows: 

» Headings written in the form of questions, embedded in tl^e text. 

• Headings written in the form of questions, placed in the margin. 

# A control text, without headings, the same width as the text with 
marginal headings (approximately 12 cms). - * 

The test . The same tv/elye short -answer test used in Experiment 1 was 
also jused in this enquiry. 

Participants * One hundred and fifty-five fourth-year comprehensive 
school pupils (aged between 14 and 15 years) of mixed-ability from 
a different school took .part in this enquiry. They v/ere divided by , 
the school into three groups of ability at English - high, middle and 
low - but taught in mixed-ability groups. 

Procedure ! • 

.■ 

The procedure was the same as that used in Experiment 1 except that 
on this occasion three conditions v/ere compared. 



Be suits 




The results obtained from this enquiry are shown in Table 3 # 
Inspection of these data suggested that it would be legitimate to 
pool 'the results from the^two headings conditions, and to compare 
them with the control .group. V/hen this had- -beeiv done a two-way 
analysis- of variance (presence/absence or headings x sex) was 
carried out. The main remits indicated: 

• an overall conditions effect : participants in the headings 
conditions (x = 6.5) recalled significantly more than participants 
in. the control group (x = 5*8). (F W'6.28, df '1,151, P = .01?); 

• a significant sex effect : boys (x = 6.6) recalled more than girls 
(x = 6.0). (F s 5-6^, df 1,151, P = i'019)^ ' 

• no significant interactions between these variables, (F = 0.05**,, 
df . 1,151, p = .816). . A 

The- results were next examined in terms of • ability daca obtainable 
from the schetol. The recall scores of the three ability groups 
(high, middle and low) were calculated, .The jneans obtained are * 
shown in Table , - * • . 

These data were subjected to a three-way analysis of variance 
(ability x presence/absence of headings x sex) followed by Scheffe' 
tests when appropriate. The results indicated: 

• high-ability participants (x = 6.9) did, significantly better than 
midde-abiiity (x = 6.0) and middle-lability did significantly 
better than low-ability (x-= 5-5)- (F = 9-223, df 2,1^3, V<-001); 



TABLE 3. The results of Experiment 2. 

• Average recall stfj^es out of 12. 
Headings in the form of 'questions. 



Headings 



Text 



Margin 



Boys 

6.8 " 
(N=28) 



6.8 
(N=21) 



Girls 
(N=26) 



6.1 

(N=29) 



Total 
6.6 



6A 

(N=50) 



Overall 



6.5 



Control 



Margin . 



6.2 

(N=22) 



5.5 ' 
(N=29) 



5.8 
(N=51) 



5.8 

(N=51) 



TABLE V The results of Experiment 2 expressed in terms of ability. 

• Boys " .Girls Total 



High Ability 



Headings 



Control,. 



. 7.2 
(N=27)..V 

6.9 

(N=8) 



6.6 

(N=21) 

6.8 

(N=10) 



6.9 

(N=A8.) 

6.8 
(N=18) 



Middle" Ability 



Headings 



Control 



6,9 * 
(N=10) 

6.2 

(N=6) 



5.7 
(N=18) 

S 

5.6 
(N=9) , 



6.1 

(N=28) 

5.8 
(N=15) 



Low Ability 



Headings 
Control 



5-9 

.(N=12) 

5.V 

(N=8) 



6.3 
(N=l6) 

k.O 
(N=10) 



6.1 

(N=28) 

if.6 
(N=18) 



ERIC 



19 



% participants viith headings did better than participants without 
headings in each" of the levels of ability (v/ith the exception of 
high-ability -girls). (F = 'f.8?6, df 1,1^3, p = .029); 

• boys did significantly better than girls in eacli of the. levels 

of ability (except for low-ability boys in the headings condition). 
(F ='Jf.363, df 1,1^3, p = .03.9); . 

• no significant interactions betvieen these three variables* 

The gain for the high-ability participants was 2^, for the middle-ability 

. . - : ^ ' it- 

it was ,5% and 1 for the low-ability it was " ' - . J 

\ 

Conclusions 

V 

The results of this experiment indicate a superiority for. headings 
v/ritten in the^form of questions, but they do not indicate any 

differential effect regarding their position. High-ability participants 

~ - - — • 

recalled; more than low-ability ones but there were no clear 
interactions between ability and the presence of headings. 

There were two main differences between the findings reported for . 
this experiment and those for Experiment 1. 

1. In this experiment the; overall scores (average x = 6.3) are 
lower than those' reported in Experiment 1 (average x = 7-2) • 
It is likely that this result reflects differences between 
the school populations used. 

2. In this experiment the percentage gain for headings written 1 
in the form of statements was 2# for high-ability pupils , 

3% . for middle-ability and * .33^ f or low-ability. 

In Experiment 1 the figures were 12#, 11# and 11# respectively. 
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Thus this experiment (whilst not producing significant interactions) . 

does seen to support the findings of Hartley, et al , '198O and 
. Hartley et al , 1981 concerning the greater effects of headings 
v written in. the form of questions with low-ability participants. 4 

•Accordingly, in planning the third experiment in this series we, 
wished. ,to compare directly the effects on recall of headings written 
in the form of statements with those wri'tten in. the. .form, of-questions. 
In»the light of the results obtained in Experiments 1 and. 2, it seemed 
reasonable .to pursue this issue with headings in 'one position - 
embedded in the text. However, before we could proceed in -this way, 
we felt it was first necessary to examine the effects-of the position' 
of headings on readers'., ease of retrieval from the passage. ^ " 



Ret r ieval Studies 



Some problems 



The. two previous studies that examined the effectiveness of headings 
as aids to retrieval "(Hartley and Burnhill, 1976; Charrow and Reddish, 
1981) both confounded the presence or abseAce of headings with other 
typographical and text changes, and therefore cannot be counted as 
pure* studies of headings* In addition, Hartley and Burnhill asked 
studertiis to find material in text they had not seen before, where*© 
Charrow indxReddisfr instructed their participants to read through, 
the passages uri^er consideration before asking- then to retrieve 



information from it* ^Accordingly, we decided to study the effects 
ITf "heading on retrieval in both fays, and not to confotfnd the issue 
vith „ qther variables- fc « s \ 

In order to measure the effectiveness of headings on retrieval it is 

* \ * * 

necessary to. measure how long it takes participants to find/retrieve 
material frpm the text. Tlfere seen* to be a number of strategies for 
doing this (such as working v;ith individuals, and timing them 
separately, or group methods involving self -timing and/or display 



clocks). We decided that it was best to keep things simple in a 

* » * * • 

classroom situation! We planned a situation where one of the 

experimenters would write a number on the blackboard, an<i;"%ien« change 
this number at regular intervals (e. g. every thirty seconds). 
, The participants^ in the experiment woi^ld .be instructed* to write down 
* the number showing .at "the start of the experiment and the number 
. showing when they_had. completed their search task. The numbers 
would £e presented in. random order in order to minimise cheating. 

* * * * * 

Pilot Studies 

Ve felt it necessary to try out the viability of this apprpach, 
so we carried out two pilot studies, one using retrieval from 
unfamiliar text and one using retrieval fror. familiar text. 

0 

In ^der to accustom participants to the situation we devised a short 
practice situation.* A paragraph of information on the life of 
Florence Nightingale was used, together v/ith three questions. 
In the first pilot study twenty participants (fourth-year pupils) 
first read a question, found the answer to the question in the 
paragraph, circled it,, and then did the next question. In the second 

• / 
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study twenty-six fourth-years first read the paragraph and then 
circled the answers to the questions in prder. This practice paragraph 
was presented without headings* 



After cpnipleting the practice task, the participants repeated the task 
with the niain passage on television viewing habits - in one of the 
usual three conditions (text headings, marginal headings, and control). 
The participants were asked to record the time they started and 'the : ' 
time they finished the task in the first pilot study, and* the* time 



they started reading, finished reading and completed the search task 



in tire second study* In both studies the participants were asked to 

search for the answers to six questions. 
» • 



Results* of the pilot studies * 

• " 

The method" of timing worked well and presented no difficulties* 
The results obtained, however, indicated no differences between 
the times taken to retrieve information from the passages with 
or without headings in either of the pilot studies,* ^ 

In view of these results (which we recognised were clearly limited 
by the small sample size in each study) we decided tb make a number • 
of changes to our procedure. These changes were informative in that 
they suggest - indirectly - sortie of the factors that might affect, 
the effectiveness of headings, as tools to aid retrieval. The changes 
were as follows: 

# The practice «heet was re-written. It contained a new topic 
(raiders), it was longer and the number of practice questions 
was increased from 3* to 5» . 



V Three versions of the practice passage were .prepared - one vith 

« m 

text 'headings, one vith marginal headings and one without 
headings, and these vere attached to the appropriate, passages 

of the main experiment* 4 . , u ' " 

• , . < 

• The headings in the practice passages were written to match %\ 

i • 

closely the search questions asked* Thus, e*g. a heading was 

•The colour of spiders 1 and the question was »What colour are *' > 

spiders that ge£ trapped in the bath? 1 * 

i • . " 

• Similarly, each of th? headings in the main passage was made ' 

* to reflect more clearly the phraseology of the search questions/' 
Thus, e.g., the heading 'The favourite programmes 1 became * 
•The most popular kind of programmes' for the search question 
•Vhat is the most popular kind of programme? 1 • 
The number of search, questions for the main task was increasfed 
from 6 -to 12 (i.e. we used the \came questions as we had used- . 

in^ the recall -studies;^ " ~ \ / * " 

• Finally, accuracy was stressed by \example* In the practice passage 

" - - - \ 

one question asked how many legs ha\i a spider? The passage 

reported that insects had .six, but spiders had eight* Pupils who 

• circled six were reminded' that they needed to read the passage * 

carefully in order" to ensure they circled the correct information* 

Similarly, other practice questions* .demanded careful reading of 

the text to obtain the correct answer. 

Following these changes, we then carried out the series of retrieval 

, studies , which, in this report, ve shall call Experiments 3* *f t 5. and & 
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The aims of Experiment Three .were ft) to sea if .headings vritten in 
the form" of statement* helped participants to find information - ; 
in text they had not see* before, and (ti to see if the position _ 
of such headings; (marginal, or embedded in the text) affected 
the readers' search times. 



Materials 



. Practice massage. Three versions of a (one-page) practice passage 
■ containing four paragraphs on the topic of spiders (based on Uhitlodc, 
♦197*0 were prepared as follows: 

Headings written in the form of, statements embedded in the text 
(approximately one per paragraph). 
. Headings written in the form of statements placed in the margin. 

• A control text, without .headings, the same width as the text 
* * . 

with cardinal statements. 

A cover sheet for the practice passage explained the procedure to 
be used and listed five questions which were to be used in -the • . 
practice search task. 

The- experimental passage. Three versions of the passage on television 
viewing habits were again used in this experiment. In this enquiry 
the .headings were in," the form of statements and only one control 
. passage vas used (the one with the shorter line-length). ^ 



The pcarch questions. The, twelve item-, short-answer test used in . 
Experiments 1 and 2 was modified for use^an^this experiment. 
Students were instructed to circle on .the passage the answers to 

the questions. • \' » % 

. * «* « * 

Participants. Approximately one hundred and seventy ^fourth-year 

comprehensive school pupils (aged between 14 and 15 y^afs) o? 

-mixed-ability from a. -thirds different, .school took part in this 
• ♦ 

enquiry. They were divided by the, school, into three groups of 

* * 

ability at English - Siigh* middle and low ~ and were taught in 

-* . • ' 
separate sets. \ 

Procedure " * 



^Booklets containing the -practice., and the experimental passages were ^ 
distributed systematically tr the participants in each of six separate 
classes. *Vhe jjaxticipants first did -the practice task as a class 
exercise, i.e. they tqpk each practice ^question in turn, and looked 
for and, circled the answer on the practice' passage. The need for ^ 
accuracy was pointed out and explained, and so too was the r^uirement 
to 'circle just that bit of the text that gives the answer 1 . 

i m x 

ft 

After completing the practice passage, the participants were told about \ 
the need for timing the experiment, and how this was to be done. 
Participants were requested to complete a 'time-of-starting-box* on the 
•front cover, and, whemithey had finished searching for the answers to 
the, twelve questions, a ''Ume-of-finishing-box' below it'. The participants 
were asked to signal (by raising their hand) when they had finished 
in order that one of the experimenters could, check that they had 
recorded correctly the time ,of finishing. The order pf the twelve 
questions for the search task was varied for each of the three .conditions, 



to minimise cheating,- and the participants v/ere asked to search 
for ^he answer-to each question in order* 

"Results a5 ' - 

Thte data, were first examined for accuracy. One hundred and 
forty-three pupil§^were~one hundred percent correct* Nineteen pupils 
.made one error:, four made, two errors, and three made more than 
two errors. With such high accuracy the results from all one hundred I- 
and sixtyrn£he participants were included in the analyses of the 
time-data. The results for the time-data ■ are shown in Table 5. 



ifospe^ion of t'hese^data suggested that it would be legit imatfe^to pool 

the results from the two headings conditions and to compare them. .with- 

the control group. When this had been- done a two-way analysis of 

variance (-presence/absence of headings x sex) was carried out. 5; 

The main results indicated:. * — - 

an overall conditions effect: participants in the headings conditions* 

> 

found the answers to the questions significantly faster 
(x = 13.0 minutes) than participants in the control group 
(x = 15.0 minutes) (F = 7.91, df 1,165, p<.006); 

• no significant ~sex effects (F = 1.95, df %165, p = .164); • 

• no significant interactions between conditions and sex 

• (E = 0,86?', df 1,165, p = .353)- * 
The results were next examined in terms of the ability groupings 
operating in the school. The means obtained are shown in Table. 6u 

These data were subjected to a threerway analysis of variance'Cability 
x presence/absence of headings x sex). The results indicated: , f . 



TABLE 5 . The results of .Experiment V* 

Average search time in- minutes to find the answers 
> to 12 questions' about unfamiliar text* 

Headings in the form of statements* 

Boys Girls Total Overall 

Text 13.2 , 13-2 1 3-2 

- (N=3D (N=26), (N=57) 13<0 

Headings (N=111) 
Margin 1^.3. 12.3 12.8 

(N=29). (N=25) " (N=5*0 

Control"- Margin' 15.8 1^.0 J5-0 0 15.o" 

(N=32) (N=26) (N=58) (N=58) 



TABLE 6. The results of Experiment 3 expressed in terras of ability. 







Boys 


Girls 


Total 




Headings 


10.2 
(N=19) 


10.5 

' ' (N=23) 


10.4 
(N=42) 


High-ability 

« 

4 


- Control- 


11.2 

(N=11 ) 


12.3 

(N=12) 


11.8 

(N=23) 




Headings 


13.1 
(K=22) 


13.3 
CN=12) 


13.2 
(N=3<0 


Middle-ability 


Control 


. 15.4 
(N=10) 


15.0 
(N=7) 


15,2 
(N=17) 



Low-ability 



Headings 



Control 



.16.3 
(N=19) 

20.8 
(N=11) 



15.5 
(N=16) 

15.9 
(N=7) 



15.9 
(N=35> 

'18.9 
(N=18) 



• . a significant ability effect: Mgh-ability participants found . 

information. significantly faster (x = 10.?'mnutes) than T 
niddle-ability. (x = 1 5? 9 minutes) and low-ability (x = 16.9 minutes) 
and middle-ability were significantly faster than the low^abiiity • 
participants (F = ^,'df -2,157, p <.001) S ' ' 
, • . a significant headings effect (F = 12.96, df 1,157, P <.001>| 
. nonsignificant sex effect (F = 0.7^5, df 1,157', P * -389); ■■" 

• no significant interactions* 



Conclusions 



The results of this experiment indicated a superiority for headings 
(written in the form of statements) but they did not indicate any , 
differential effect regarding, their position. HighUbility^participant 
-searched, faster than low-ab ility ones, but there were no interactions 
between ability and the presence/absence of headings, ^ 

To test whether theW findings would be" replicated^witH headings^ 
•• in the form of questions we next carried out Experiment C 



EXPERIMENT FOUR 



Air. 



The aim of this experiment was to replicate Experiment Three using 
headings written in the form of questions instead, of headings written 
in the form of statements. ^ 
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Materials, Tho same as Experiment Three, except that the headings 
ih the practice and experimental passages v/ere written in. the form , 
of questions. * , 

Participants . Approximately one hundred and fifteen fourth-year 
comprehensive school pupils as before (but from a fourth school) 
took part in this enquiry.. There were two high-ability classes,* 
one medium, and two (small) low-ability ones. These pupils were 
grouped in terms of mathematical ability, and, taught in separate 
sets. s 

Procedure ^ 

* v • 

3 

The procedure was the the sane as that used in Experiment Three. 
Participants who made more than three errors (N=5) were excluded 
from the analyses of time-data. - 



Results " * 

The results from this enquiry are shovm in Table 7* Inspection .of 
these data suggested that it would be legitimate to pool the results 
from the tv/o headings conditions and to compare, them with the control 
group. When this had been done a two-way analysis of variance 
(presence/absence of headings x sex) was carrie^^ut.. The main results, 
indicated: ' * ' „ - 

m an overall conditions effect : participants in the headings 
conditions found the answers to the questions signif icantly 
faster «(x = -11.8 minutes) than participants in the control group 
(x * 13.^ minutes) (F = df 1,99» P <-05); 
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TABLE 7'. The results of Experiment-^ ; ■■ 

~ ' v time in minutes to find' the .answers 

Average search- -^.2.™.; text. 



Average searcn -- — ~ 

to 12 questions about unfamiliar text. 

Headings in the 'form of questions 



Headings 



Text 



Margin 



Boys 

11. h 
(11=1 6) 

12.8 
(N=i8) 



Girls. 

11.9 
(N=19) 

11.0 
(N=16) 



Total 

11.7 

(N=35> 

12.0 



Overall 



11.9 

(N=69) 



Control 



Margin 



13.2 
' (N=16) 



13.6 
(N=18) 



13.4 

(N=3M 



13'. 1 * 



P.* 



* 1 . v 

TABLE 8. She result, of Experiment expressed tn terms o«$bOit J r. 

— 4 



High-ability 



—Headings- 



Control 



Boys- 

j.1.6 — 
(N=16) 

10.0 
(N=7) 



-Girls 

J0.1 
(N=21) 

12.3 
(N=11) 



. Total 

■10.5 f 
(N=37) 

11.4 

(N=18). 



Low-ability 



Headings 
Control ... 



13.2 
(N=18) 

15.6 
(N=9) 



13.6 
(N=1^) 

1.5.5 
(N=7) 



.13.4 
(N=32) 

15.6 
(N=16) 



•■ ■ • / • • • 

• no significant sex effect (F = .176, df 1,99, P = .676); 
_• no significant interaction (F = .465^ df 1,99, P*= »^97). 

fi * * _ ■' ' ' 

* * t 

.The results were next examined in terms of the mathematics ability * _ * * 
grouping data providejd by the school* The results from the two / 
high-ability classes were combined and compared with those /from tHe three 
lower-abiiity classes* The means ^ obtained are, shown in Table 8 V 

" «• * < « 

These* data were subjected to a three-way analysis of variance 
(ability x presence/absence of headings x sex). , The results " T 

indicated: 

. <? 

e a significant ability effect : the high-ability participants 
found • 'information significantly faster (x = 10*8 minutes) 
than the low-ability participants, (x = 1*f.1 minutes) (-F = 25.521; 
df 1,95, p<.001); '1 

« a significant conditions effect (F = 4.833, df 1,95, P Kc°^U 
V lib signxhcant sex ef feet (F r = JD?7 ^f~lY95t_P = >79g) ; ^IZT5I 

e no significant interact ions. . 

/; * ^ / • 

' . EXPERIMENT FIVE 

Aims .... "** ' 

******** • * * 

The aims of Experiment Five were (i). to see if headings, written in the 
form of statements helped participants to retrieve information from a 

text which they had just previously read and were thus t to some extent, ' 

i 

familiar with, and (ii) to see if the position of such headings 
(marginal or embedded in the text) affected the participants speed • 
of retrieval* * »■ 



v: 



Materials. The same materials that^were used "in Experiments Three 
and Four were also used in this experiment tyith one or two slight 4 
modifications. (See procedure.) The number of search questions for 
the main: passages va| Reduced from 12 to 10 to reduce the time .taken 
to complete the experiment. 



i€s. J 



Participles. Approximately one .hundred^ fourth-year comprehensive 
school pupils as before (but from a fifth "school) took part in this > 
enquiry. . There was one high-ability class,, two midcjle-ability ones, 
* and one of low-ability. 



Procedure 



Booklets containing practice and experimental passages were distributed 
as before. In this experiment, however, participants first read-' 
the practice passage and then found the answers for the practice 
_ quest ions, irua dassrgroup exercise Following, .this. they, were- then- ^ - 
asked;, to read their respective experimental passages for a period of 
six minutes. They were informed after four minutes had elapsed 
that two minutes remained, and'they were instructed that, if they 
finished in the time available,, they should look oyer their passage. 



When the reading period was completed, it was explained to the participants 

how searching for answers to the^questions would be timed* The participant) 

* *. 

were asked to complete a f time-of-starting-box f (at the top of the 

search list) and to complete a f time-of-f inishing-box f (at the bottom) 

** ^ • 

f * 

when they had completed the task. - They were asked to signal 

'(by raising their hands) when they; had finished so that one of the 

experimenters could check that they had done everything correctly. Again th 
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participants were asked to 'search for the answers to the questions > 
in order,/ These instructions took approximately three minutes 
to give, so that there was this period of delay between reading 
the text ana searching it in orde£ to find the answers to the 
questions. In this experiment the numbers on the blackboard were 
changed every twenty seconds (instead of every thirty seconds as 
in ,the previous experiments). , 

Again,, participants who made more than, three errors (N=2) were * 
excluded from the analyses of the tine-data. 

• .* 

Results 

The experimental results are summarised in Table $. As in previous 
studies inspection of this table suggests that it would be legitimate 

to pool the data for the two headings conditions and to compare them 

» - - _ ■ 

with the control group. A two-way analysis of variance (presence/absence, 
of headings x sex) was employed. The results indicated: 

• an overall conditions effect : participants in the headings groups - 

retrieved the .answers to the questions" significantly faster 

t 

(x = 8.0 minutes) than- those in the control gro.up (x = 10.2 minutes) . • 
]j = 14.2, di 1,96, p <_.001i * . 

no significant sex effect (F > 0.00, df 1 f 96 f p = .998); 

• - no significant interaction (F = 0.^62, df 1 ,96, p=.*^92). 



The results Wer?;.next fex^Qined^in;- terlns^of the scfibol-based%abxiity „ 
groupings. As hpiid above "there >;&s -one ■high-ability class, 
two nidcle-ability .ones, and one; iow^linity one* The-;ineans obtained; 
are shown -la.. Table 10. 



The data were subjected- to a three-way analysis- of variance (ability, x 
presence/absence of headings x\sex) : . The- results showed: 

• a significant ability effect (F = J%k r df 2,88, p<.001):_ 

the high-ability participants (x s 7.3 minutes) and the middlerability 

participants (x = 8.2 minutes)^ both retrieved information significantly; 

* / * 1 * 

faster than the low-ability ones (x = 12*0 minutes) (Schef fe' test ■ 

P <«01); 

• a significant conditions effect (F = 25*2, df 1,88, p<*001);^ 

• no significant sex effect (F = O.j'f, df 1,88, p = .561);. 
f a significant sex x ability interaction (F = 5«A9.t df 2,88,, p<£.666) 

(a consequence of the poorer performance of the low-ability girls); 

• no other significant interactions between these variables,, - - 
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TABLE 9 . The -results- .of Experiment 5. *> - * 

Average retrieval time in minutes to find the ansvjeri *i 
to 10 questions about familiar text. ; ' 

Headings in the form of. statement Si ,- 



Headings 



Text 



Margin 



Boys 

8*1 * 
(N=19) 

8.0 

(N=20) 



- Girls 

' 8.1 r 
(N=1*f) 

7.* 



Total 

-v 

8.1 ■ 
(N=33) 

-7.8. , 



Overall 

■ y . 

8.0 

(N=67)". 



Control 



Margin 



9.9 

(N=19) 



10.5 

01=1*0 



.10.2 
•(N=3J) 



10;2< 
(N=33) 



TABLE 10. The results of Experiment 5 expressed in terms of ability ^ 



Boys 

■ Headings 7.k 



High-abilit; 




Control 



8.3 

(N=&) 



5.8 



9-3 

(N=5) 



Girls Total 



(N=10) (N=10) (N=20) . 



8.9 

(N=9) •« 



Middle-ability 



Headings 



Control 



7.5 7.5 

(N=21=). <N=13) 



9.5 

(N=11) 

\ 



9.2 
(N=7) 



7-5 

(N=18) 



V 



Low-ability 



Headings 



Control' 



10.0 
(K=8) 

12.6 " 
(N=*0 



(N=5 : ) 

\ _ 
18.0 
<N=2) 



10.9 • 
(N=13) 

(N=6) 



EXPERIMENT SIX 



Aim 



The aim of this experiment ;was to replicate Experiment Five using 
headings written in the form 6$ questions instead of headings 
written in the form of statements. 



Materials. The same as Experiment Five, except that the headings 
in the practice and the experimental passages were written in the- 
r fqrm^of questions* * - - 



Participants. Approximately one hundred and fifteen .fourth-year 
comprehensive school 'pupils as before (but from a sixth school) 



took part in this enquiry. There were two high-ability English 

v ■ * . / 

classes, 'one medium-ability, and two low-ability ones., 

* ■ * 

Procedure ' % 



The procedure was- the same as that used in Experiment Five 

except that the high-ability pupils were given five minutes 

to read the passage , the medium-ability six minutes, and the" 

•® 

*i * 

low-ability seven minutes. , Participants who made more than three 

errors in finding the answers to the questions (N=6) were excluded 

* 

from the analyses of the time-^data. 

The results obtained are summarised in Table 11; As before, 
inspection of these data suggested that it, would be legitimate to 
pool the data for the two headings conditions and to compare them 



Wiethe control group. A two-way analysis of variance 

.(presence/absence of headings x sex) was employed. The**results 

« 

showed: 

• an overall conditions effect participants in the headings groups 
retrieved the answers to the questions ^significantly faster 

(x = 7.5 minutes)* than those; in the control group (x = 8.9 minutes).' 

\ : 

(r= 6.11, df 1,99 ,.P<-015); ; - \ 

no significant sex effect (F = 0.13, df 1,99, P = .717); ■ • \ 

• no significant interactions (F = 0.21, df 1,99, P = .&*&)• 



The data were ..next examined^ terms of the ability groupings used 
by the school. The, results from the two higher-ability classes were 
combined anH compared with those obtained from the three lower-ability 
ones. The means obtained are shown in Table 12 # " <, 



These data were subjected to a three-way analysis of ^rariance „ , 
(ability x presence/absence of headings x sex),. These,, respite 
indicated: , r .f \ 

• a significant conditions effect (? = 8.93* df 1,95, R^OCWt/ 

• a significant ability effect : higher-ability partibipants retrieved 
information more quickly (x s 6.* 3 minutes) than lower-ability ones * 

. (x = 9.1 minuted). (F = ^•b3» df 1,95,' P ^001^; 

• no significailt^sex effect (F = 0*12, df 1,95, P = •72*0; 

• no significant interactions between these variables* * 



TABLE 1-1 The results of Experiment 6. 

Average retrieval time in minutes to find the answers 
to 10 questions about, familiar text. 

Headings in the form of questions.. 



^.Boys Girls Total. Overall 

Text 8.1 7.2 7.5 

• (N=12) (N=21) (N=33) 15 

Headings (i=6S) 

Margin. 7.3 7> . 7* *' 

- (N=13) (N=23) (N=36) 

t * 

* " ... ' 

Controls Margin " 8.8 9-0 8.9 ■ 8.9 

(N=15) (N=19) (N=3^) (N=3»0 



TABLE 12. The results of Experiment' 6 expressed in terms , of ability. 



v Boys * Girls Total ; 

Headings 6.3 5.9 6.0 

• (N=11) (N=20) (N=3D 

-High-ability - • ^ r > 

Controls 7.7 6.5 7.0 

(N=7) (N=9) (N=16) 



Headings 8.7 8.4 * 8.5 

(N-^) (N=2lf) - (N=38) 

Low-ability 

* J '• Controls 9-7' 11.2 10.5 - 

(N=8) <v , (N=1Q} (N=18) 



SUMMARY AND DISCUSSION 

r 



Th* e^sults from the first six experiments are blear cut. In these 
experiments headings have helped both the recall of information, \ ' ' 
and tljVvTetrieyal 6t information (from familiar and unfamiliar text). 
These results have been found whether or 'not the headings were *' 
written in the jform of statements or questions, and whether. or not I* . v 
the headings were embedded, in the text car placed in the margin. " ^ ' 

And, in /our of the; e3q>eriment^ headings have helped less-able children ■ 
more. The size of the effects for headings is shown in Tables 13 arid 1*U 

v - • * 

- . * * * • 

It is clearly premature to discuss in full the results described in' 

* <i> m - #% * 

this report; as. our- series of experiments is not yet complete, and ,we 

wisfi to replicate and extend our findings with other texts, 

,and different age and ability groups. And, of course, it is too> 

early to generalise from these findings to stating Jiow one might 

design different kinds "of instructional text. We~~have-not--yetu_. 

examined,, for. example, different ways of denoting typographically * m . 

headings embedded in fext, and/or headings which convey different 

* . **■ r 

levels of text structure (see Twyman, 1981). 

Nonetheless, a few-pertinent, remarks might be made hdre. ,It will not 

> * 
have escaped the readers* attention that our approach is a-theoretical. 

We are not driven by any particular notions about text structure 

nor by any strong views about mathemagenics or cognitive psychology^ * 

Nonetheless, we do have some views on why we have found the results 

that ve have, and our findings certainly have implications for 

psychologists more theoretical than ourselves. A 



Ve think headings work because,:: , - 

they help readers appre&atf the structure and organisation t>f 
the text; ^ ... - x 

• they help readers bridge the gap between paragraph comprehension 
and text comprehension (Calfee, 1981); 

• they make the intentions of the writer clearer to the readers; 
they help readers to see how the text fits in with their own . * 
prior knowledge or schemata - about both the content of the tex^' 
and how the text as likely to be structured; 

• they help as retrieval cues when it comes to recall. * » 
x (Holley et al, 198l). 

/ . • . ; 

Ve think that headings guide reader-text interactions and particularly 
thstt they help less-able readers to envisage more easily schemata which 
are relevant to the .task* We L think that this may especially "be the 
case with headings written in the form of questions. Adjunct questions 
.need not necessarily aid "recall, but it is likely that headings 
in the form of questions will provide a clearer guidance to readers 
about the author's .purpose. Others have indicated that headings in 
the form of questions are useful if readers themselves approach the text 
with questions in mind (e.g. see Flower et al , 1980, and Anon, 1981). 

One implication 9f this view is that we would expect headings to be 
'effective for recall when the material to be learned is not 'totally 
unfamiliar to the reader.,, or not totally irrelevant. In our experiments 
our readers are all familiar with the contents of the passage. - 
they know all about different television channels, different programs 
and they know their own likes and dislikes. Cpnsequently the content 
makes Sense to them: ail the passage does is to organise this material, 



Experiment 1. Recall score 

Headings as statements 

Experiment 2. Recall score 

* Headings as questions 



Experiment 3J\ Search time 

1 * Headings as statements 

i 

Experiment *f. Search time 
y ' ' Headings as questions 



11.2 
12.1 



15-5 
13.1 



Experiment 5- 
Experiment 6. 



Retrieval *time 
Headings as statements 

Retrieval time 
Headings as questions 



27.5 
19.5 



^ TABLE 1*f. The percentage .gain for headings in the different 
ability groups. 

Experiment 1. High-ability 11.5 

Middle-ability 10.7 

Low-ability. 10.6 

Experiment 2. High-ability 1.5 
Middle-ability 5.2 

. * Low-ability 32.6 



Experiment 3- 



High-ability 

Middle-ability 

Low-ability 



Experiment *f. High-ability 
Lowrability 



Experiment 5* 



High-ability 

Middle-ability 

Low-tab'ility 



Experiment 6* High-ability 
Low-ability 



13.5 
15.2 

18.9 

8.6 
16.** 



3**.8 

25.3 
32.1 

16. 7 
23.5 



and to give it some concrete realisation. We would suggest that 
investigators who use materials whose contents are totally unfamiliar 
to their readers, or totally irrelevant (e.g. Cole, 1977) would not / 
find headings to be very effective. (Cole did not.) Unfortunately, 
however, it has proved difficult, if not impossible, to support 
this prediction from the research summarised iri Panel 1. 
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